Multi-sensor motion detection

ABSTRACT

Use of multiple sensors to determine whether motion of an object is occurring in an area is described. In one aspect, an infrared (IR) sensor can be supplemented with a radar sensor to determine whether the determined motion of an object is not a false positive.

CLAIM FOR PRIORITY

This application is a continuation of U.S. patent application Ser. No.16/000,743, entitled “Multi-Sensor Motion Detection,” and filed on Jun.5, 2018, which claims priority to U.S. Provisional Patent ApplicationNo. 62/633,017, entitled “Optimization and Testing of Wireless Devices,”and filed on Feb. 20, 2018, both of which incorporated herein byreference in its entirety.

TECHNICAL FIELD

The disclosure relates to motion detection, and in particular motiondetection using different types of sensors.

BACKGROUND

Cameras for home or business security uses can include an infrared (IR)sensor and an image sensor such as a complementarymetal-oxide-semiconductor (CMOS) image sensor (or charge-coupled device(CCD) image sensor). The IR sensor can be used to detect motion in aninfrared portion of the electromagnetic spectrum, for example,wavelengths of 700 nanometers (nm) to 1 millimeter (mm). If motion isdetected using the IR sensor, then the IR sensor can provide a signal toa microcontroller which, upon receiving the signal, can turn on theimage sensor and other components of the camera such that video in thevisible light portion of the electromagnetic spectrum, for example,wavelengths of 400 nm to 700 nm, can be recorded using the CMOS imagesensor.

Many of cameras are often battery-powered to provide easy installationfor users. However, if the IR sensor provides a false positive motiondetection, the other components of the camera can be turned on to beginthe video recording process. The resulting video would show nothing ofinterest to the user and, therefore, the camera unnecessarily drainedsome of its battery. Moreover, the user might be notified of thedetected motion, for example, via a message delivered to a smartphone.The user might then want to watch the video and find that there isnothing of interest due to the false positive. Thus, the user experiencecan be degraded.

SUMMARY

Some of the subject matter described herein includes a method including:determining, by a processor, a first indication of a motion of a firstobject in an area based on a first sensor that is responsive towavelengths in a first, non-visible light region of an electromagneticspectrum; receiving first video data depicting the motion of the firstobject in the area as recorded by an image sensor that is responsive towavelengths in a visible light portion of the electromagnetic spectrum;determining, by the processor, a second indication of the motion of thefirst object in the area based on a second sensor that is responsive towavelengths in a second, non-visible light region of the electromagneticspectrum; determining, by the processor, with both of the firstindication of the motion and the second indication of the motion thatthe motion of the object is not a false positive determination of motionin the area; and providing the first video data to a cloud server forviewing the motion of the first object in the area based on thedetermination that the motion is not a false positive.

In some implementations, the first sensor is an infrared (IR) sensor,and the IR sensor and the image sensor are part of a camera having afield of view including the area.

In some implementations, the method includes adjusting motion detectionthresholds used by the camera to determine motion of objects in thearea, the motion detection thresholds related to characteristics of themotion that are considered in a determination that motion is occurringin the area.

In some implementations, the method includes: determining, by theprocessor, a second indication of motion of a second object in the areabased on the first sensor; receiving second video data depicting themotion of the second object in the area; determining, by the processor,that the second sensor did not provide an indication of the secondobject in the area; determining, by the processor, that the secondindication of the motion of the second object is a false positivedetermination of motion based on the second sensor not providing theindication of the motion of the second object in the area; andrefraining from providing the second vide data to the cloud server basedon the determination of the motion of the second object being a falsepositive determination of motion.

In some implementations, the first sensor is an infrared (IR) sensor,the method further includes adjusting motion detection thresholdsrelated to the IR sensor to change sensitivity of the IR sensor tomotion occurring in the area.

In some implementations, adjusting motion detection thresholds includesadjusting characteristics of motion that are considered when motion ofan object in the area results in a determination of motion occurring inthe area.

In some implementations, the second sensor is a radar sensor.

Some of the subject matter described herein also includes an electronicdevice, including: one or more processors; and memory storinginstructions, wherein the processor is configured to execute theinstructions such that the processor and memory are configured to:determine a first indication of a motion of a first object in an areabased on a first sensor that is responsive to wavelengths in a first,non-visible light region of an electromagnetic spectrum; receive firstvideo data depicting the motion of the first object in the area asrecorded by an image sensor that is responsive to wavelengths in avisible light portion of the electromagnetic spectrum; determine asecond indication of the motion of the first object in the area based ona second sensor that is responsive to wavelengths in a second,non-visible light region of the electromagnetic spectrum; determine withboth of the first indication of the motion and the second indication ofthe motion that the motion of the object is not a false positivedetermination of motion in the area; and provide the first video data toa cloud server for viewing the motion of the first object in the areabased on the determination that the motion is not a false positive.

In some implementations, the first sensor is an infrared (IR) sensor,and the IR sensor and the image sensor are part of a camera having afield of view including the area.

In some implementations, the processor is configured to execute theinstructions such that the processor and memory are configured to adjustmotion detection thresholds used by the camera to determine motion ofobjects in the area, the motion detection thresholds related tocharacteristics of the motion that are considered in a determinationthat motion is occurring in the area.

In some implementations, the processor is configured to execute theinstructions such that the processor and memory are configured to:determine a second indication of motion of a second object in the areabased on the first sensor; receive second video data depicting themotion of the second object in the area; determine that the secondsensor did not provide an indication of the second object in the area;determine that the second indication of the motion of the second objectis a false positive determination of motion based on the second sensornot providing the indication of the motion of the second object in thearea; and refrain from providing the second vide data to the cloudserver based on the determination of the motion of the second objectbeing a false positive determination of motion.

In some implementations, the first sensor is an infrared (IR) sensor,and the processor is configured to execute the instructions such thatthe processor and memory are configured to adjust motion detectionthresholds related to the IR sensor to change sensitivity of the IRsensor to motion occurring in the area.

In some implementations, adjusting motion detection thresholds includesadjusting characteristics of motion that are considered when motion ofan object in the area results in a determination of motion occurring inthe area.

In some implementations, the second sensor is a radar sensor.

Some of the subject matter described herein also includes a computerprogram product including one or more non-transitory computer-readablemedia storing computer program instructions, execution of which by aprocessing system causes the processing system to perform operationsincluding: determine a first indication of a motion of a first object inan area based on a first sensor that is responsive to wavelengths ininfrared first, non-visible light region of an electromagnetic spectrum;receive first video data depicting the motion of the first object in thearea as recorded by an image sensor that is responsive to wavelengths ina visible light portion of the electromagnetic spectrum; determine asecond indication of the motion of the first object in the area based ona second sensor that is responsive to wavelengths in a second,non-visible light region of the electromagnetic spectrum; determine withboth of the first indication of the motion and the second indication ofthe motion that the motion of the object is not a false positivedetermination of motion in the area; and provide the first video data toa cloud server for viewing the motion of the first object in the areabased on the determination that the motion is not a false positive.

In some implementations, the first sensor is an infrared (IR) sensor,and the IR sensor and the image sensor are part of a camera having afield of view including the area.

In some implementations, the execution of the computer programinstructions causes the processing system to perform operationscomprising adjust motion detection thresholds used by the camera todetermine motion of objects in the area, the motion detection thresholdsrelated to characteristics of the motion that are considered in adetermination that motion is occurring in the area.

In some implementations, the execution of the computer programinstructions causes the processing system to perform operationsincludes: determine a second indication of motion of a second object inthe area based on the first sensor; receive second video data depictingthe motion of the second object in the area; determine that the secondsensor did not provide an indication of the second object in the area;determine that the second indication of the motion of the second objectis a false positive determination of motion based on the second sensornot providing the indication of the motion of the second object in thearea; and refrain from providing the second vide data to the cloudserver based on the determination of the motion of the second objectbeing a false positive determination of motion.

In some implementations, the first sensor is an infrared (IR) sensor,and wherein the execution of the computer program instructions causesthe processing system to perform operations including adjust motiondetection thresholds related to the IR sensor to change sensitivity ofthe IR sensor to motion occurring in the area.

In some implementations, adjusting motion detection thresholds includesadjusting characteristics of motion that are considered when motion ofan object in the area results in a determination of motion occurring inthe area.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example of multi-sensor motion detection.

FIG. 2 illustrates an example of a block diagram for multi-sensor motiondetecting using a radar sensor.

FIG. 3 illustrates an example of a block diagram for multi-sensor motiondetecting using wireless data.

FIG. 4 illustrates an example of adjusting motion detection thresholds.

FIG. 5 illustrates an example of a block diagram for adjusting motiondetection thresholds.

FIG. 6 illustrates an example of a simplified block diagram of anelectronic device which may be used with some implementations.

DETAILED DESCRIPTION

This disclosure describes techniques for using multiple sensors formotion detection. In one example, a camera can include an IR sensor thatcan be used to detect motion by determining the motion of heat in theinfrared portion of the electromagnetic spectrum. Upon detection ofmotion, the IR sensor can send a signal to a microcontroller. Themicrocontroller can then turn on other components of the camera, forexample, a CMOS image sensor to begin recording in the visible lightportion of the electromagnetic spectrum to generate a video depictingthe object producing the motion as it is within the field of view of thecamera. The microcontroller can also turn on a wireless device (e.g., anInstitute of Electrical and Electronics Engineers (IEEE) 802.11 wirelesscommunications semiconductor circuit) to allow for the recorded video tobe uploaded to a base station and then uploaded by the base station to acloud server for viewing by the user. The cloud server can also notifythe user via a message to the user's smartphone that motion was detectedin the field of vision of the camera and the video produced by the imagesensor of the camera is available for viewing.

A supplemental sensor can work in conjunction (e.g., at a similar orsimultaneous time) with the IR sensor of the camera to detect motion viaanother technique. For example, a radar sensor can be used to determinewhether motion is detected in the field of vision of the camera bygenerating electromagnetic waves in the radio spectrum (e.g., 3 hertz(Hz) to 3 terahertz (THz)) or the microwave spectrum (e.g., 300megahertz (MHz) to 300 gigahertz (GHz)) and detecting the reflections ofthose electromagnetic waves off objects. A base station can thendetermine whether both the IR sensor and the radar sensor detectedmotion in the same area. If so, then this can be a positivedetermination of motion detection. The base station can then provide therecorded video to a cloud server for the user to view later, or providea notification to the cloud server that motion was detected. This canallow for the user to be notified that motion was detected and the usercan then decide whether to watch the video.

By using multiple and different types of sensors to detect motion, thenumber of false positives can be reduced. For example, if the IR sensorindicates that motion is detected but the radar sensor does not indicatethat motion is detected, then this can be determined by the base stationto be a false positive (i.e., there is no motion, or the motion is notimportant or relevant enough to alert a user). This can result in thebase station to not upload the video to the cloud server, resulting inreduced bandwidth usage, reduced storage of videos at the cloud server,and reduced notifications to the user of motion detections that ended upbeing false positives. These can improve the user experience of thecamera.

The base station can also adjust the sensitivity of the sensors tomotion. For example, if the IR sensor in the above example provided afalse positive, then information that it uses to detect motion can bechanged. For example, a motion detection threshold can be adjusted suchthat the IR sensor is less sensitive to motion. Thus, characteristics ofmotion, such as trajectory of that motion within the field of vision(e.g., an object has to move at a higher speed to be determined to bepositive determination of motion), areas within the field of vision formotion to be detected (e.g., motion should be within eight feet of theIR sensor to trigger a motion determination that is relevant to the userwhile motion more than eight feet away can be determined to beirrelevant), or different types of motion (e.g., objects moving in astraight line might be determined to not be relevant motion) might beconsidered differently by the camera and used to trigger the IR sensorto indicate that motion has been detected. However, the characteristicsof motion that previously provided the false positive can no longercause the IR sensor to determine that motion occurred in its field ofvision. This can also improve the user experience as described above.Additionally, this can improve the user experience by having the motiondetection be adjusted over time. This can then consider changes in theenvironment of the sensors, for example, new next-door neighbors, morestreet traffic, more vegetation growth, etc. that can be accounted forto reduce the number of false positives.

Similarly, the number of false negatives can be reduced. For example, ifthe IR sensor detects motion but the radar sensor does not detectmotion, and if the video is analyzed to determine that there was motionthat is of interest to the user, then the radar sensor's sensitivity canbe adjusted to be more sensitive. This can also improve the userexperience.

In more detail, FIG. 1 illustrates an example of multi-sensor motiondetection. In FIG. 1, camera 105 includes field of vision 110 in whichmovement can be detected and if detected, video data can be generated toproduce a video to play back what occurred within field of vision 110.For example, as previously discussed, camera 105 can include an IRsensor to determine motion and a CMOS image sensor that can be turned onto record video if the IR sensor detects motion within field of vision110. In FIG. 1, this results in information or data such as motiondetected 120 being provided to base station 130, which can provide anindication that motion was detected within field of vision 110 (e.g.,the movement of intruder 115). Alternatively, or additionally, video 125(e.g., video data including image frames depicting the movement ofintruder 115 within field of vision 110) can be generated by camera 105using the image sensor and then provided to base station 130. Forexample, providing video 125 to base station 130 can also be anindication that motion was detected.

Radar sensor 140 can be a supplemental sensor for detecting motionwithin field of vision 110 or in the general vicinity of field of vision110 (e.g., more area than what is covered by field of vision 110) thatcan serve as a type of second opinion regarding whether the movement ofthe object within field of vision 110 is relevant or important for theuser, or even if it is real. For example, radar sensor 140 can generateelectromagnetic waves 160 that can be reflected off objects within fieldof vision 110, including intruder 115. By analyzing these reflections,radar sensor 140 can determine that motion is occurring within field ofvision 110. As a result, radar sensor 140 can provide information suchas motion detected 135 to base station 130 to indicate that motion wasdetected via radar. Thus, both camera 105 and radar sensor 140 candetermine whether motion is occurring within field of vision 110 withinthe same or similar time. As a result, when intruder 115 crosses intofield of vision 110, both camera 105 and radar sensor 140 can alert basestation of this detected movement.

In some implementations, radar sensor 140 can be integrated within basestation 130, radar sensor 140 may be a stand-alone device, radar sensor140 can be integrated within camera 105, or all of camera 105, basestation 130, and radar sensor 140 can be integrated into a singledevice. Radar sensor 140 can determine speed, distance from radar sensor140, direction (e.g., approaching or retreating from radar sensor 140),or other characteristics of the position, location, or movement ofobjects. Radar sensor 140 can be a wide band radar, ultra-wideband (UWB)radar, continuous wave frequency modulation (CWFM) radar, or other typeof radar.

Base station 130 can be communicatively coupled with camera 105 andradar sensor 140 via physical wiring or wireless technologies such asIEEE 802.11, Bluetooth, etc. Base station 130 can also becommunicatively coupled with cloud server 155, for example, via anInternet connection. Base station 130 can provide notifications ofdetected movement within field of vision 110 (e.g., the sidewalk leadingup to a home's front door) to cloud server 155, for example, via motionnotification 150. Upon receiving motion notification 150, cloud server155 can generate a message delivered to the user's (e.g., homeowner)smartphone providing an indication that motion was detected in the areawhere the user set up camera 105 (e.g., within field of vision 110).This can allow the user to be informed of a possible security situationat home.

Base station 130 can also upload, or provide, video 125 to cloud server155. As previously discussed, video 125 can be the result of imagesensor of camera 105 being used to record the activity occurring withinfield of vision 110 when the IR sensor of camera 105 was used todetermine that motion has been detected. Video 125 can be stored bycloud server 155 and provided to the user to view, for example, via asmartphone, web browser on a computer, etc. so that the nature of thedetected motion can be determined. For example, in FIG. 1, intruder 115moving within field of vision 110 can be viewed by the user.

In FIG. 1, because both the IR sensor of camera 105 and radar sensor 140detected motion, motion notification 150 and video 125 are provided tocloud server 155. That is, base station 130 has determined that both theIR sensor of camera 105 and radar sensor 140 have detected motion and,therefore, cloud server 155 should be notified and/or provided video125. However, if radar 140 does not detect motion, but the IR sensor ofcamera 105 does detect motion, then base station 130 might not providevideo 125 or motion notification 150 to cloud server 155 because thiscan be an indication of a false positive regarding the motion that wasdetermined by the IR sensor to be occurring. That is, there is actuallyno intruder moving within field of vision 110. Rather, some otheractivity, for example, an insect moving along the IR sensor of camera105 might have triggered the IR sensor to provide a false positive.Other examples of scenarios in which the IR sensor might produce a falsepositive include temperature fluctuations, for example, by sunlightbeing incident upon the IR sensor.

In another example, radar sensor 140 can detect motion within field ofvision 110, but the IR sensor of camera 105 might not detect motion and,therefore, video might not be recorded using the image sensor of camera105. In this example, if radar sensor 140 (or another type supplementalsensor) detects motion, then this can be prioritized by base station 130and used by base station 130 to provide data to camera 105 to beginrecording. Thus, video 125 can be generated and provided to cloud server155.

Though the example in FIG. 1 uses radar sensor 140, other types ofsensors can be used. For example, as discussed later, motion can bedetected using a wireless mesh network implementing an IEEE 802.11compliant wireless network.

FIG. 2 illustrates an example of a block diagram for multi-sensor motiondetecting using a radar sensor. In FIG. 2, motion can be determined tobe occurring within an area using an IR sensor (205). For example, inFIG. 1, camera 105 can include an IR sensor to detect motion occurringwithin field of vision 110 (e.g., the area that the IR sensor ispointing towards). The detection of the motion can be based on the IRsensor generating a voltage in response to heat detected in its field ofvision. If the source of the heat moves, this results in a change inthat voltage. Accordingly, this change in voltage can be used todetermine that the IR sensor has detected motion. In someimplementations, the IR sensor can be a passive infrared (PIR) sensor.This detection of motion can be a first indication of motion withinfield of vision 110. However, as previously discussed, this firstindication can be a false positive or be the result of motion that is ofrelatively no interest to a user and, therefore, should not be used todetermine that motion has occurred.

The detection of motion can then be used to cause camera 105 to generatea video using an image sensor to visually depict that motion. Dataregarding the motion and/or the video can then be provided to andreceived by base station 130 (207).

Motion can also be determined to be occurring within an area using aradar sensor (210). This can be a second indication of motion of thesame object as a double-checking or verification of the motiondetermined by the IR sensor of camera 105. For example, in FIG. 1, radarsensor 140 can generate electromagnetic waves 160 and determinereflections of those waves off objects within field of vision 110 anddetermine whether there is movement upon an analysis of thosereflections. Data regarding the motion can then be provided to andreceived by base station 130 as a determination of motion.

The base station can then determine that both the IR sensor and theradar senor determined that motion occurred in the same or generallysame area (213). This can be an indication that the motion of the objectis not a false positive and that it is likely to be of interest for auser to be alerted regarding the presence of the object within field ofview 110.

A notification indicating that motion was detected and/or a video ofportraying the area when the motion was detected can then be provided toa cloud server (215) such that a user can be informed of the motion. Forexample, in FIG. 1, video 125 and/or motion notification 150 can beprovided to cloud server 155 by base station 130 if both camera 105 andradar sensor 140 provide motion detected 120 and motion detected 130,respectively, or if camera 130 provides a video. Thus, if both the IRsensor of camera 105 and radar sensor 140 detect motion within field ofvision 110, video 125 can be generated by the image sensor of camera 105and then provided to base station 130. Because radar sensor 140 alsoindicates that motion has occurred within field of vision 110, video 125can then be uploaded to cloud server 155. If radar sensor 140 did notindicate that motion occurred within field of vision 110, then basestation 130 might discard the video (e.g., not upload it to cloud server155).

In some implementations, base station 130 might locally store video 125for later viewing by the user rather than uploading to cloud server 155if radar sensor 140 does not indicate that motion is detected. In someimplementations, base station 130 might provide video 125 to cloudserver 155 along with information indicating that radar sensor 140 didnot detect motion (i.e., that only the IR sensor of camera 105 detectedmotion within field of vision 110). Cloud server 155 might then storevideo 125, but not provide an alert to the user as this can be a falsepositive. Video 125 can then be analyzed by cloud server 155 todetermine why it was a false positive. In some implementations, video125 that is related to a false positive can be stored for later viewingby the user. For example, this can represent a video of less importantor relevance to the user and, therefore, a notification might not beprovided but the video still available for the user in case the userwould like to view the video later.

Other types of supplemental sensors other than radar 140 in FIG. 1 canbe used to provide a second opinion or determination regarding thepresence of motion within field of view 110. For example,characteristics of a wireless network within the property in whichcamera 105 and base station 130 are within can be used to determine thatmotion has occurred. For example, Bluetooth (e.g., implementing apersonal area network (PAN)) or wifi (e.g., IEEE 802.11 implementing awireless local area network (WLAN)) devices can be used to determinethat motion has occurred.

For example, radio frequency (RF) characteristics of the wirelessnetwork can be used to determine that motion has occurred. In oneexample, the channel state information (CSI) in wireless communicationsprovides channel properties of a wireless communications link, forexample, between base station 130 and a wireless access point (AP). CSIcan be provided by each packet as it is transmitted to or from basestation 130 and an AP. The CSI can include a significant amount ofinformation that can be analyzed by a variety of methodologies todetermine that motion is occurring within the physical space that thewireless network is implemented within. For example, changes ordeviations in the expected amplitude or phase of the signals asindicated in the CSI can be used to determine that motion has occurred.Thus, characteristics or changes in those characteristics of the CSI canbe used to determine that motion has occurred.

FIG. 3 illustrates an example of a block diagram for multi-sensor motiondetecting using wireless data. In FIG. 3, motion can be determined tohave occurred in an area using an IR sensor (305). Motion can also bedetermined using wireless data (310). For example, base station 130 canbe using the same wireless network as one being provided by one or moreaccess points. Base station 130 can receive CSI data from these otheraccess points and based on the CSI data, base station 130 can determinethat motion has occurred in the area. A notification indicating thatmotion was detected and/or video depicting the motion can then beprovided to a cloud server (315). This can occur if base station 130determines that motion was detected by the IR sensor of camera 105 andthe CSI data.

A variety of machine learning or statistical analysis can also be usedto adjust the sensitivity of the sensors to motion. FIG. 4 illustratesan example of adjusting motion detection thresholds. In FIG. 4, cloudserver 405 can include logic to determine whether any data orinformation used by camera 105 or radar sensor 140 used to detect motionshould be adjusted. For example, if radar sensor 140 does not detectmotion in an area that the IR sensor of camera 105 detected motion, thenthis discrepancy between the determinations of radar sensor 104 andcamera 105 can be provided to cloud server 155. In some implementations,video 125 can also be provided. Cloud server 155 can then providefeedback 405 (e.g., based on the discrepancy, an analysis of video 125,etc.) to base station 130 which can in turn provide motion thresholdadjustment 415 to camera 105. Motion threshold adjustment 415 caninclude information regarding changes that camera 105 should implementsuch that the sensitivity of its motion detection is changed. This caninclude changing the characteristics of the motion that are used todetermine whether motion is occurring within field of vision 110. Forexample, if the IR sensor previously detected motion in a scenario thatended up being a false positive, then the motion determinationsensitivity of camera 105 can be changed such that when the samescenario occurs, it does not indicate that meaningful motion occurred(i.e., no motion of interest to the homeowner occurred). This wouldresult in the camera not determining that motion occurred within fieldof vision 110 even though before the adjustments were applied, the sametype of motion would have triggered a determination that motionoccurred.

In one example, this can include changing the distance from the IRsensor in which motion can be determined. Motion threshold adjustment415 can be processed by camera 105 such that movement closer to the IRsensor would result in a motion determination while movement fartheraway would not result in a motion determination. In another example, thespeed of motion can be adjusted such that objects would need to movefaster or slower for motion to qualify as detectable motion to result inrecording video or providing a notification to the user regarding themotion. In another example, the expected trajectory of the objectswithin field of vision 110 can be changed to change when camera 105determines that motion has occurred. Thus, only some types of motionmight be determined to be important or relevant to the user if the typesof motion meets these motion thresholds.

Base station 130 can also provide motion threshold adjustment 410 toradar sensor 140 such that the motion thresholds for radar sensor 140can also be changed in a similar manner.

FIG. 5 illustrates an example of a block diagram for adjusting motiondetection thresholds. In FIG. 5, motion can be determined to haveoccurred using an IR sensor (505). For example, motion within field ofview 110 of camera 105 in FIG. 5 might occur and that motion might havecharacteristics resulting in a determination that motion of interest toa user is occurring within field of vision 110. This can result in basestation 130 being alerted to this motion.

Next, no motion might be detected from a supplemental sensor (510). Forexample, radar sensor 140 in FIG. 4 might not detect motion within fieldof view 110. This information regarding the lack of motion can beprovided to base station 130 and base station 130 can then determinethat motion was determined using camera 105 but not radar sensor 140.This can be indicative of a false positive of motion detection relatedto camera 105.

Base station 130 can then determine how to adjust motion determinationthresholds of the IR sensor to reduce false positives (515). Forexample, in FIG. 4, base station 130 can provide information to cloudserver 155 regarding the false positive as well as the motion thresholdsused by camera 105 and/or radar sensor 140 when the characteristics ofmotion within field of view 110 is analyzed and determined to be motionof important or relevance to the user, as previously discussed. Anygenerated video data can also be provided. Cloud server 155 can analyzethe received information and determine how to adjust the motiondetermination thresholds of the IR sensor to reduce these falsepositives. In another implementation, base station 130 can determine howto adjust the motion determination thresholds of the IR sensor withoutcontacting cloud server 155. Upon determining how to adjust the motiondetermination thresholds, base station 130 can provide motion thresholdadjustment 415 to camera 105 to update its motion thresholds such thatdifferent characteristics of motion would result in differentdeterminations regarding movement occurring within field of vision 110in the future. For example, camera 105 might be adjusted such that fewerdeterminations of motion can be determined.

Camera 105 in FIG. 1 can include radar sensor 140 integrated within it.Integrating radar sensor 140 into camera 105 can result in the samepower supply (e.g., battery) used to power both the IR sensor of camera105 and radar sensor 140. However, use of radar sensor 140 might causethe battery of camera 105 to discharge quickly due to the higher powerrequirements to operate radar sensor 140. The IR sensor can have lowerpower requirements than radar sensor 140. To preserve or extend thebattery life of camera 105, radar sensor 140 can be initially turnedoff. When the IR sensor is triggered upon motion, this can also causeradar sensor 140 to be turned on to determine whether the motion can beverified using radar. After the determination of whether there is motionor after the operation of radar sensor 140 to allow for thedetermination is complete, radar sensor 140 can then be turned off.Thus, radar sensor 140 can be used only at times when it is to provide asupplemental determination of an object moving.

In some implementations, radar sensor 140 of camera 105 can beperiodically turned on. For example, radar sensor 140 can be turned onfor five minutes, then turned off for ten minutes, and then turned onagain for five minutes, and so forth.

In some implementations, camera 105 can be optionally hard wired into ahome's electrical system. Thus, camera 105 in this situation would notneed to use a battery to operate radar sensor 140. Camera 105 can detectwhether the power supply is a battery or the electrical system (e.g.,connected with the electrical grid of an interconnected network fordelivering electricity). If camera 105 is using a battery, then radarsensor 140 can be turned on and off as described above (i.e., when theIR sensor is triggered). If camera 105 is determined to be on theelectrical system (i.e., not dependent on the battery), then radarsensor 140 can be turned on without the need to turn it offperiodically.

The operational parameters of radar sensor 140 can also be adjusted toreduce power consumption and extend the battery life of radar sensor 140and, therefore, extend how long radar sensor 140 can operate beforeneeding to change or recharge the battery. For example, transmissionparameters related to how electromagnetic waves 160 are generated byradar sensor 140 and propagated can be adjusted. In one example, if theamount of motion detected using the IR sensor is small (e.g., a smallchange in voltage produced by the IR sensor), then this small amount ofmotion might have a higher change of being a false positive. In thiscase, radar sensor 140 can then be turned on to verify the results ofthe IR sensor. By contrast, if the amount of motion is large, then radarsensor 140 can remain off because a large amount of motion might have alower change of being a false positive. The amount of motion can be howfast the movement is, how large the object that is moving is, direction,acceleration, or other characteristics of motion as described herein. Inanother example, if the amount of motion is small, then the transmissionparameters related to how electromagnetic waves 160 are generated can beadjusted to be different than if the amount of motion is large. Forexample, the frequency or frequencies used (of electromagnetic waves160), pulse width, amplitude, pulse repetition frequency (e.g., howoften or how many pulses of electromagnetic waves 160 are emitted), orother characteristics can be changed to extend battery life in certainidentified situations such as the amount of motion or movement.

FIG. 6 illustrates an example of a simplified block diagram of anelectronic device which may be used with particular implementations. Theelectronic device of FIG. 6 can implement any of the functionalities andfeatures discussed above, including base station 130. However, thecomponents can also be used to implement camera 105 and radar sensor140.

For example, FIG. 6 portrays a high-level block diagram illustrating aprocessing device 2500 implementing base station 130 in which at leastsome operations described herein can be implemented. In someimplementations, the block diagram can also implement the other devicesdescribed herein, such as camera 105 and radar sensor 140. Theprocessing system can be a system that can run any of themethods/algorithms/techniques described above.

In the illustrated embodiment, the processing device 2500 includes oneor more processors 605, memory 610, antenna 615, and one or more radios620. Processors 605 may be or include, for example, one or moregeneral-purpose programmable microprocessors or microprocessor cores,microcontrollers, application specific integrated circuits (ASICs),programmable gate arrays, or the like, or a combination of such devices.The processor(s) 605 control the overall operation of the processingdevice 2500. Memory 610 may be or include one or more physical storagedevices, which may be in the form of random access memory (RAM),read-only memory (ROM) (which may be erasable and programmable), flashmemory, miniature hard disk drive, or other suitable type of storagedevice, or a combination of such devices. Memory 610 may store data andinstructions that configure the processor(s) 605 to execute operationsin accordance with the techniques described above. Processing device2500 can also include communication devices that may be or include, forexample, an Ethernet adapter, cable modem, Wi-Fi adapter, cellulartransceiver, Bluetooth transceiver, or the like, or a combinationthereof. Depending on the specific nature and purpose of the processingdevice 2500, it can also include I/O devices that can include devicessuch as a display (which may be a touch screen display), audio speaker,keyboard, mouse or other pointing device, microphone, camera, etc.Processing device 2500 can also include radios 620, for example, adifferent radio for each band that communication links can beestablished within. Processing device 2500 can also include one or moreantennas 615 for aiding the establishing of the communication links. Forexample, radio 620 can generate a signal that is transmitted via antenna615.

While processes or blocks are presented in a given order, alternativeembodiments may perform routines having steps, or employ systems havingblocks, in a different order, and some processes or blocks may bedeleted, moved, added, subdivided, combined, and/or modified to providealternative or sub-combinations, or may be replicated (e.g., performedmultiple times). Each of these processes or blocks may be implemented ina variety of different ways. In addition, while processes or blocks areat times shown as being performed in series, these processes or blocksmay instead be performed in parallel, or may be performed at differenttimes. When a process or step is “based on” a value or a computation,the process or step should be interpreted as based at least on thatvalue or that computation.

Software or firmware to implement the techniques introduced here may bestored on a machine-readable storage medium and may be executed by oneor more general-purpose or special-purpose programmable microprocessors.A “machine-readable medium”, as the term is used herein, includes anymechanism that can store information in a form accessible by a machine(a machine may be, for example, a computer, network device, cellularphone, personal digital assistant (PDA), manufacturing tool, any devicewith one or more processors, etc.). For example, a machine-accessiblemedium includes recordable/non-recordable media (e.g., read-only memory(ROM); random access memory (RAM); magnetic disk storage media; opticalstorage media; flash memory devices; etc.), etc.

Note that any and all of the embodiments described above can be combinedwith each other, except to the extent that it may be stated otherwiseabove or to the extent that any such embodiments might be mutuallyexclusive in function and/or structure.

Although the present invention has been described with reference tospecific exemplary embodiments, it will be recognized that the inventionis not limited to the embodiments described, but can be practiced withmodification and alteration within the spirit and scope of the appendedclaims. Accordingly, the specification and drawings are to be regardedin an illustrative sense rather than a restrictive sense.

Physical and functional components (e.g., devices, engines, modules, anddata repositories, etc.) associated with processing device 2500 can beimplemented as circuitry, firmware, software, other executableinstructions, or any combination thereof. For example, the functionalcomponents can be implemented in the form of special-purpose circuitry,in the form of one or more appropriately programmed processors, a singleboard chip, a field programmable gate array, a general-purpose computingdevice configured by executable instructions, a virtual machineconfigured by executable instructions, a cloud computing environmentconfigured by executable instructions, or any combination thereof. Forexample, the functional components described can be implemented asinstructions on a tangible storage memory capable of being executed by aprocessor or other integrated circuit chip. The tangible storage memorycan be computer readable data storage. The tangible storage memory maybe volatile or non-volatile memory. In some embodiments, the volatilememory may be considered “non-transitory” in the sense that it is not atransitory signal. Memory space and storages described in the figurescan be implemented with the tangible storage memory as well, includingvolatile or non-volatile memory.

Each of the functional components may operate individually andindependently of other functional components. Some or all of thefunctional components may be executed on the same host device or onseparate devices. The separate devices can be coupled through one ormore communication channels (e.g., wireless or wired channel) tocoordinate their operations. Some or all of the functional componentsmay be combined as one component. A single functional component may bedivided into sub-components, each sub-component performing separatemethod step or method steps of the single component.

In some embodiments, at least some of the functional components shareaccess to a memory space. For example, one functional component mayaccess data accessed by or transformed by another functional component.The functional components may be considered “coupled” to one another ifthey share a physical connection or a virtual connection, directly orindirectly, allowing data accessed or modified by one functionalcomponent to be accessed in another functional component. In someembodiments, at least some of the functional components can be upgradedor modified remotely (e.g., by reconfiguring executable instructionsthat implements a portion of the functional components). Other arrays,systems and devices described above may include additional, fewer, ordifferent functional components for various applications.

While embodiments have been described in the context of fullyfunctioning computers, those skilled in the art will appreciate that thevarious embodiments are capable of being distributed as a programproduct in a variety of forms and that the disclosure applies equally,regardless of the particular type of machine or computer-readable mediaused to actually effect the embodiments.

From the foregoing, it will be appreciated that specific embodiments ofthe invention have been described herein for purposes of illustration,but that various modifications can be made without deviating from thescope of the invention. Accordingly, the invention is not limited exceptas by the appended claims.

I/We claim:
 1. A method comprising: determining, by one or moreprocessors, an indication of motion of an object in an area using afirst sensor; determining, by the one or more processors, a lack ofmotion in the area using a second sensor; adjusting, by the one or moreprocessors, motion detection thresholds of at least one of the firstsensor or the second sensor using machine learning applied to adiscrepancy between determinations made by the first sensor and thesecond sensor; determining, by the one or more processors, motion ofobjects in the area using the motion detection thresholds; and sending,by the one or more processors, video data from the first sensor to aserver for viewing the motion of the objects in the area.
 2. The methodof claim 1, wherein the first sensor is an infrared (IR) sensor, thesecond sensor is an image sensor, and the IR sensor and the image sensorare part of a camera having a field of view including the area.
 3. Themethod of claim 2, further comprising: adjusting, by the one or moreprocessors, motion detection thresholds of the IR sensor to modifysensitivity of the IR sensor to the motion of the objects in the area.4. The method of claim 1, further comprising: determining, by the one ormore processors, that the indication of motion of the object in the areausing the first sensor is a false positive determination based on thelack of motion in the area determined using the second sensor; andrefraining, by the one or more processors, from sending the video datafrom the first sensor to the server based on determining that theindication of motion of the object is a false positive determination. 5.The method of claim 1, wherein the second sensor is a radar sensor. 6.The method of claim 5, further comprising: powering on, by the one ormore processors, the radar sensor to determine the lack of motion in thearea responsive to determining the indication of the motion of theobject using the first sensor.
 7. The method of claim 1, whereinadjusting the motion detection thresholds comprises causing, by the oneor more processors, the at least one of the first sensor or the secondsensor to determine the motion of the objects in the area based on atrajectory of the objects in the area.
 8. The method of claim 1, whereinadjusting the motion detection thresholds comprises causing, by the oneor more processors, the at least one of the first sensor or the secondsensor to determine the motion of the objects in the area based on adistance of the objects in the area from the at least one of the firstsensor or the second sensor.
 9. The method of claim 1, whereindetermining the motion of the objects in the area is based on channelstate information (CSI) of a wireless communications link between theone or more processors and a wireless access point (AP).
 10. The methodof claim 9, wherein determining the motion of the objects in the area isfurther based on deviations from an expected amplitude or phaseindicated by the CSI.
 11. An electronic device, comprising: one or moreprocessors; and memory storing instructions, wherein the processor isconfigured to execute the instructions such that the processor andmemory are configured to: determine an indication of motion of an objectin an area using a first sensor; determine a lack of motion in the areausing a second sensor; adjust motion detection thresholds of at leastone of the first sensor or the second sensor using machine learningapplied to a discrepancy between determinations made by the first sensorand the second sensor; determine motion of objects in the area using themotion detection thresholds; and send video data from the first sensorto a server for viewing the motion of the objects in the area.
 12. Theelectronic device of claim 11, wherein the first sensor is an infrared(IR) sensor, the second sensor is an image sensor, and the IR sensor andthe image sensor are part of a camera having a field of view includingthe area.
 13. The electronic device of claim 12, wherein the processorand memory are further configured to: adjust motion detection thresholdsof the IR sensor to modify sensitivity of the IR sensor to the motion ofthe objects in the area.
 14. The electronic device of claim 11, whereinthe processor and memory are further configured to: determine that theindication of motion of the object in the area using the first sensor isa false positive determination based on the lack of motion in the areadetermined using the second sensor; and refrain from sending the videodata from the first sensor to the server based on determining that theindication of motion of the object is a false positive determination.15. The electronic device of claim 11, wherein the second sensor is aradar sensor.
 16. The electronic device of claim 15, wherein theprocessor and memory are further configured to: power on the radarsensor to determine the lack of motion in the area responsive todetermining the indication of the motion of the object using the firstsensor.
 17. The electronic device of claim 11, wherein the instructionsto adjust the motion detection thresholds cause the at least one of thefirst sensor or the second sensor to determine the motion of the objectsin the area based on a trajectory of the objects in the area.
 18. Theelectronic device of claim 11, wherein the instructions to adjust themotion detection thresholds cause the at least one of the first sensoror the second sensor to determine the motion of the objects in the areabased on a distance of the objects in the area from the at least one ofthe first sensor or the second sensor.
 19. The electronic device ofclaim 11, wherein determining the motion of the objects in the area isbased on channel state information (CSI) of a wireless communicationslink between the one or more processors and a wireless access point(AP).
 20. A computer program product including one or morenon-transitory computer-readable media storing computer programinstructions, execution of which by a processing system causes theprocessing system to: determine an indication of motion of an object inan area using a first sensor; determine a lack of motion in the areausing a second sensor; adjust motion detection thresholds of at leastone of the first sensor or the second sensor using machine learningapplied to a discrepancy between determinations made by the first sensorand the second sensor; determine motion of objects in the area using themotion detection thresholds; and send video data from the first sensorto a server for viewing the motion of the objects in the area.